TITLE OF THE INVENTION 
IMAGE STORAGE APPARATUS, EXTERNAL IMAGE PROCESSING 
APPARATUS , CONTROL METHOD FOR IMAGE STORAGE APPARATUS 
AND CONTROL METHOD FOR EXTERNAL IMAGE PROCESSING 
5 APPARATUS 

FIELD OF THE INVENTION 

The present invention relates to an image storage 
apparatus, an external image processing apparatus, a 
10 control method for the image storage apparatus and a 
control method for the external image processing 
apparatus . 

BACKGROUND OF THE INVENTION 

15 Conventionally, for printing an image sensed by a 

digital image sensing apparatus such as a digital 
camera, image data is downloaded to a computer such as 
a personal computer on a temporary basis, and is then 
outputted to a printer connected to the computer using 

20 an application for printing the image. 

In the above technique, the user retrieves list 
information and file names of images based on 
information displayed on a display using an application 
on the computer, and selects output data to print the 

25 data* Recently, on the other hand, a color print 

system allowing digital image data to be transferred 
from a digital camera directly to a color printer 
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without using a PC and printed by the color printer, so 
called a photo direct (PD) printer in which a memory 
card installed in a digital camera and storing picked- 
up images is inserted directly in a color printer so 
5 that the picked-up images stored in the memory can be 
printed, and the like have been developed. 

Since the specifications and the operation method 
of the digital camera are different for each 
manufacturer, desired is a photo direct printer 

10 apparatus capable of accommodating digital cameras of 
various kinds of manufacturers upon transferring image 
data from the digital camera directly to the printer to 
print the data. For the printer apparatus allowing a 
digital camera of each manufacturer to be connected 

15 directly thereto to print data, it is required that 

print information optionally set in each camera should 
be matched to the print conditions in the printer 
apparatus . 

20 SUMMARY OF THE INVENTION 

The present invention has been made in 
consideration of the above situation, and has as its 
object to provide an image storage apparatus such as an 
image sensing apparatus or external image processing 

25 apparatus capable of storing an image making use of the 
portability and easily carrying out processing such as 
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the printing of a sensed image by the external image 
processing apparatus. 

Another object of the invention is to provide an 
image storage apparatus such as an image sensing 
5 apparatus or external image processing apparatus or 

control methods for the apparatuses making it possible 
to automatically recognize the external image 
processing apparatus at the time when the image sensing 
apparatus is connected to the external image processing 
10 apparatus in a wired or wireless manner to transfer an 
image signal and to control processing such as printing 
in an optimum mode by the external image processing 
apparatus . 

According to the present invention, the foregoing 
15 object is attained by providing an image sensing 
apparatus comprising an image sensing unit which 
converts an optical image of an object into an electric 
image signal, an interface capable of communicating 
with an external processing apparatus, and a control 
20 unit which transfers the image signal to the external 
processing apparatus to process the same, wherein the 
control unit comprises: a determination unit which 
determines whether control relation between the image 
sensing apparatus and the external processing apparatus 
25 is a first type in which a memory in the image sensing 
apparatus can be accessed directly from the external 
processing apparatus, or a second type in which 
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processing in the external processing apparatus can be 
controlled by a controller of the image sensing 
apparatus, by communication with the external 
processing apparatus via the interface; and a 
5 processing controller which changes a processing 

procedure for processing an image in the image sensing 
apparatus by the external processing apparatus based on 
the result of the determination. 

Further, the foregoing object is also attained by 

10 providing a control method for an image sensing 
apparatus comprising an image sensing unit which 
converts an optical image of an object into an electric 
image signal, an interface capable of communicating 
with an external processing apparatus, and a control 

15 unit which transfers the image signal to the external 
processing apparatus to process the same, the control 
method comprising: determining whether control 
relation between the image sensing apparatus and the 
external processing apparatus is a first type in which 

20 a memory in the image sensing apparatus can be accessed 
directly from the external processing apparatus, or a 
second type in which processing in the external 
processing apparatus can be controlled by a controller 
of the image sensing apparatus, by communication with 

25 the external processing apparatus via the interface; 
and changing a processing procedure for processing an 
image in the image sensing apparatus by the external 
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processing apparatus based on the result of the 
determination . 

According to the present invention, the foregoing 
object is also attained by providing an processing 
5 apparatus communicating with an image sensing apparatus 
which converts an optical image of an object into an 
electric image signal and comprises an interface 
capable of communicating with the processing apparatus, 
comprising: a determination unit which determines 

10 whether control relation between the image sensing 

apparatus and the processing apparatus is a first type 
in which a memory in the image sensing apparatus can be 
accessed directly from the processing apparatus, or a 
second type in which processing in the processing 

15 apparatus can be controlled by the image sensing 

apparatus, by communication with the image sensing 
apparatus via the interface; and a processing 
controller which changes a processing procedure for 
processing an image in the image sensing apparatus by 

20 the processing apparatus based on the result of the 
determination . 

Further, the foregoing object is also attained by 
providing a control method for an processing apparatus 
communicating with an image sensing apparatus which 

25 converts an optical image of an object into an electric 
image signal and comprises an interface capable of 
communicating with the processing apparatus, 
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comprising: determining whether control relation 
between the image sensing apparatus and the processing 
apparatus is a first type in which a memory in the 
image sensing apparatus can be accessed directly from 
5 the processing apparatus, or a second type in which 
processing in the processing apparatus can be 
controlled by the image sensing apparatus, by 
communication with the image sensing apparatus via the 
interface; and changing a processing procedure for 

10 processing the image in the image sensing apparatus by 
the processing apparatus based on the result of the 
determination . 

Furthermore, according to the present invention, 
the foregoing object is also attained by providing an 

15 image storage apparatus comprising a storage unit which 
stores an electric image signal, an interface capable 
of communicating with an external image processing 
apparatus, and a control unit which transfers the image 
signal to the external image processing apparatus to 

20 process the same, wherein the control unit comprises: 
a determination unit which determines whether control 
relation between the image sensing apparatus and the 
external image processing apparatus is a first type in 
which the storage unit in the image storage apparatus 

25 can be accessed directly from the external image 
processing apparatus, or a second type in which 
processing in the external image processing apparatus 
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can be controlled by a controller of the image storage 
apparatus, by communication with the external image 
processing apparatus via the interface; and a 
processing controller which changes a processing 
5 procedure for processing an image in the image storage 
apparatus by the external image processing apparatus 
based on the result of the determination. 

Further, according to the present invention, the 
foregoing object is also attained by providing an image 

10 processing apparatus communicating with an image 

storage apparatus which stores an electric image signal 
and comprises an interface capable of communicating 
with the image processing apparatus, comprising: a 
determination unit which determines whether control 

15 relation between the image storage apparatus and the 
image processing apparatus is a first type in which a 
memory in the image storage apparatus can be accessed 
directly from the image processing apparatus, or a 
second type in which processing in the image processing 

20 apparatus can be controlled by the image storage 

apparatus, by communication with the image storage 
apparatus via the interface; and a processing 
controller which changes a processing procedure for 
processing an image in the image storage apparatus by 

25 the image processing apparatus based on the result of 
the determination . 
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Further, the foregoing object is also attained by 
providing a control method for an image storage 
apparatus comprising a storage unit which stores an 
electric image signal, an interface capable of 
5 communicating with an external image processing 

apparatus, and a control unit which transfers the image 
signal to the external image processing apparatus to 
process the same, the method comprising: determining 
whether control relation between the image storage 

10 apparatus and the external image processing apparatus 
is a first type in which a memory in the image storage 
apparatus can be accessed directly from the external 
image processing apparatus, or a second type in which 
processing in the external image processing apparatus 

15 can be controlled by a controller of the image storage 
apparatus, by communication with the external image 
processing apparatus via the interface; and changing a 
processing procedure for processing an image in the 
image storage apparatus by the external image 

20 processing apparatus based on the result of the 
determination . 

Further, the foregoing object is also attained by 
providing a control method for an image processing 
apparatus communicating with an image storage apparatus 

25 which stores an electric image signal and comprises an 
interface capable of communicating with the image 
processing apparatus, the method comprising: 
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determining whether control relation between the image 
storage apparatus and the image processing apparatus is 
a first type in which a memory in the image storage 
apparatus can be accessed directly from the image 
5 processing apparatus, or a second type in which 

processing in the image processing apparatus can be 
controlled by the image storage apparatus, by 
communication with the image storage apparatus via the 
interface; and changing a processing procedure for 

10 processing the image in the image storage apparatus by 
the image processing apparatus based on the result of 
the determination . 

Other features and advantages of the present 
invention will be apparent from the following 

15 description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate an embodiment of the invention and, together 
with the description, serve to explain the principles 
25 of the invention. 

FIG. 1 is a block diagram showing an example of a 
system configuration constituted by an image sensing 
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apparatus and an external image processing apparatus 
according to an embodiment of the present invention; 

FIG. 2 is an explanatory view showing a software 
configuration of the image sensing apparatus and a 
5 printing apparatus according to the embodiment of the 
present invention; 

FIG. 3 shows a configuration of the printing 
apparatus according to the embodiment of the present 
invention; and 

10 FIG. 4 is a flowchart showing a protocol between 

the image sensing apparatus and the printing apparatus 
and a flow of processing in the both apparatuses 
according to the embodiment of the present invention. 

15 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiment of the present invention will 
be described in detail in accordance with the 
accompanying drawings . 

FIG. 1 is a block diagram showing a system 
20 configuration according to the embodiment of the 
present invention . 

In the example of the image sensing and printing 
system of this embodiment shown in FIG. 1, an image 
sensing apparatus (e.g. digital camera) main body 10 as 
25 an image storage apparatus of this embodiment comprises 
an image sensing system 10-a, a CPU -lOd, a memory 10-e, 
a group of parts for user interface 10-i and an 
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interface 10-h, an interface for internal devices 10-j, 
an interface for external devices 10-k and an external 
storage apparatus 10-1, and the foregoing modules are 
connected to one another by a system bus 10-b and a 
5 local bus 10-c. 

The group of parts for user interface 10-i 
includes a display unit (liquid crystal display unit) 
for displaying picked-up images , simple messages and 
the like, and a various kinds of buttons such as a 

10 shutter button to be pressed when capturing an image, a 
print button to be used when printing an image, and a 
button for selecting a menu item displayed on the 
display unit . 

The image sensing apparatus main body 10 can 

15 communicate with a printing apparatus 11 via the 
interface for external devices 10-k. 

Further, assigned to the memory 10-e are a module 
10-f for managing communication protocols between the 
image sensing apparatus main body 10 and the printing 

20 apparatus 11 as external image processing apparatus 

(including, for example, an external display apparatus, 
a printing apparatus, an external recording apparatus 
and an external computer) , a module 10-m for creating 
an image list table of image data stored in the 

25 external storage apparatus 10-1 as a detachable (e.g., 
card-type or disc-type) image memory, a module 10-g for 
generating printer controlling codes, a system managing 



- 11 - 



module 10-n for managing the entire image sensing 
system 10 , and an image list buffer lO-o . 

In the above conf iguration, the shutter button 
provided in the group of parts for UI 10-i is pressed, 
5 whereby image data picked up in the image sensing 

system 10-a is stored as a file in the external storage 
apparatus 10-1 as digital image data. 

In this embodiment, when image data is stored in 
the external storage apparatus 10-1, the image data 

10 obtained by image sensing is compressed in the JPEG 
format and stored. 

On the other hand, the printing apparatus 11 
comprises a CPU 11-a, a memory 11-d, a printer 
controlling system 11-i and a controller 11-h and an 

15 interface for external devices 11-e, and the foregoing 
modules are connected to one another by a system bus 
11-b and a local bus 11-c. To the memory 11-d, a 
module 11-f for managing communication protocols 
between the printing apparatus 11 and the image sensing 

20 apparatus 10, a printing buffer 11-j for storing 

printer controlling codes transferred from the image 
sensing apparatus, and a module 11-g for interpreting 
the codes are assigned. 

In this embodiment, the system managing module 10- 

25 n in the memory 10-e always manages messages from the 
image sensing system 10-a, the interface for internal 
devices 10- j , the interface for external devices 10-k 
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and the user interface 10-h. The communication 
protocol managing module 10-f manages signals 
inputting/outputting to/from the interface for external 
devices 10-k, namely communication with the printing 
5 apparatus 11. 

A communication system for connecting between the 
image sensing apparatus main body 10 and the external 
image processing apparatus 11 may have either a wired 
or wireless form. As for the image storage apparatus, 

10 any apparatus which incorporates a storage unit for 

storing an image may be used, and the present invention 
is not limited to the image sensing apparatus. 

The configurations of main parts concerned with 
control of the printing apparatus according to the 

15 embodiment will now be described with reference to FIG. 
3. 

In FIG. 3, reference numeral 3000 denotes a 
control unit (control board) . Reference numeral 3001 
denotes an ASIC (dedicated custom LSI) , reference 

20 numeral 3002 denotes a DSP (digital signal processor) , 
which has a CPU therein and takes the task of various 
kinds of control processing and image processing such 
as conversion of a luminance signal (RGB) to a density 
signal (CMYK) , scaling, gamma conversion, error 

25 diffusion and the like. Reference numeral 3003 denotes 
a memory, which has a program memory 3003a storing a 
control program of the CPU of the DSP 3002 , a RAM area 
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storing a runtime program, and a memory area storing 
image data and the like. Reference numeral 3004 
denotes a printer engine, and in this case, a printer 
engine for an inkjet printer printing color images 
5 using color inks of a plurality of colors is installed. 
Reference numeral 3005 denotes a USB connector as a 
port for connecting with the digital still camera 3012. 
Reference numeral 3006 denotes a connector for 
connecting a viewer 1011. Reference numeral 3008 is a 

10 USB hub, and when the printing apparatus performs 
printing based on image data from a PC (external 
computer) 3010, data from the PC 3010 is directly 
passed and outputted to a printer engine 3004 via a USB 
3021. In this way, the connected PC 3010 can exchange 

15 data and signals directly with the printer engine 3004 

to perform printing (functions as a general PC printer) . 

Reference numeral 1009 denotes a card slot, into 
which an adapter capable of installing a memory card is 
inserted, and image data stored in the memory card can 

20 be directly read via this adopter and printed. The 
memory card (PC) is, for example, Compact Flash 
(registered trademark) Memory, Smart Media (registered 
trademark) , Memory Stick (registered trademark) or the 
like. Reference numeral 1011 denotes a viewer (liquid 

25 crystal display unit) , which is detachable from the 
printing apparatus main body, and is used for 
displaying an image and/or an index image of each frame 
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when searching an image to be printed out of images 
stored in the PC card, and so on. Reference numeral 
1012 denotes a USB terminal for connecting a digital 
camera. Further, a USB connector 1013 for connecting a 
5 personal computer (PC) is provided on the rear face of 
the printing apparatus. 

Reference numeral 3009 is a power source connector, 
which inputs direct current into which commercial 
alternating current is converted by a power source 3011. 
10 Reference 3010 denotes a general personal computer 
(PC); 3013, the memory card (PC card) described 
previously; and 3012, a digital still camera. 

Furthermore, the exchanging of signals between the 
control unit 3000 and the printer engine 3004 is 
15 performed via the USB 3021 described previously or an 
IEEE 1284 bus 3022. 

In this embodiment, the control of communication 
between the printing apparatus and the digital camera 
is performed using a general file and a general format, 
20 which is intended to adapt to the case of second type 

where NCDP (New Camera Direct Print) independent of the 
interface is used. 

FIG. 2 shows one example of a configuration of 

NCDP. 

25 In this figure, reference numeral 600 denotes an 

interface compliant with USB, and reference numeral 601 
denotes an interface compliant with Bluetooth. 
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Reference numeral 602 denotes an application layer that 
is incorporated when a system by NCDP is built. 
Reference numeral 603 denotes a layer for executing 
existing protocols and interfaces, and in this case, 
5 the PTP (Picture Transfer Protocol), the BIP (Basic 

Image Profile) of SCSI and Bluetooth, the USB interface, 
and the like are implemented- The NCDP according to 
the embodiment is designed based on the premise that 
architectures of these protocol layers and the like are 

10 implemented, and the NCDP is implemented thereon as an 
application. Here, the printing apparatus 1000 is 
defined as a USB host, and the camera 3012 is defined 
as a USB slave, and as shown in FIG. 2, they both have 
a NCDP structure. 

15 Operations in this embodiment will now be 

described. 

First, processing is started at step SI, and 
communication is automatically started by, for example, 
wired connection between the digital still camera 3012 

20 as an image sensing apparatus and the printing 

apparatus 1000 (step S2) . Then, at step S3, whether 
the NCDP has been implemented in both the camera and 
printing apparatus is determined, and if it has been 
implemented (i.e., NO in step S2), processing proceeds 

25 to the NCDP, whereas if it has not been implemented in 
one of the camera and the printing apparatus, 
processing by MSC (Mass Storage Class) is performed. 
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That is, in the MSC mode, the memory in the camera 
can be accessed from the printing apparatus, but the 
controller of the camera cannot be accessed from the 
printing apparatus. For example, some of the 
5 conventional printing apparatus of conventional type do 
not implement the above described NCDP. Therefore, if 
this MSC type printing apparatus is connected to the 
NCDP type camera, it may be impossible to perform 
printing, or miss printing may occur. But in the 

10 embodiment of the present invention, whether the second 
mode allowing processing control (print control) of the 
external image processing apparatus to be performed 
from the image sensing apparatus implementing the NCDP 
is used or not is checked in initial communication in 

15 order to prevent the above problem. Also, if the 

camera and the printing apparatus can not communicate 
in NCDP, switching is automatically made to print 
control as MSC (i.e. the procedure in which it is 
determined that the first mode of directly accessing 

20 the memory of the image sensing apparatus from the 

external image processing apparatus is used, and image 
data in the image sensing apparatus is drawn, and is 
thereafter printed) , and therefore the above problem 
does not arise. Also, inconvenience such that an 

25 operator makes operational errors, or is confused is 
eliminated. 
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Furthermore, in the case of the MSC, the monitor 
of the camera is switched to the energy-saving mode to 
turn the monitor of the camera off, or display of 
"operate the printer" is provided and image display and 
5 the like are dismissed, at step S4. 

In association therewith, the monitor on the 
printer side is turned on. 

Then, whether an image transfer switch provided on 
the printer side has been turned on or not is checked 
10 at step S5. 

If it is determined that the image transfer switch 
has been turned on at step S5, processing proceeds to 
step S6, where image data in the camera is transferred 
to the printer, the image data from the camera is 
15 collectively transferred to the memory in the printer 
apparatus. This is because the problem such that the 
battery of the camera is down can be avoided by 
collectively transferring image data in the camera. 
Then, thumbnail images of a plurality of images 
20 transferred to the monitor on the printer side are 
displayed for search. 

Then, at step S7, processing waits until an image 
to be printed is designated, and also waits until the 
print switch is pressed. When the print switch is 
25 turned on, the operation of printing the designated 
Image is performed at step S8. After the print 
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operation in step S8 is completed, processing returns 
to step S7. 

If it is determined that the NCDP has been 
implemented in both the camera and printing apparatus 
5 at step S3, processing proceeds to step S9, where 

display of "perform the print operation" is provided on 
the camera monitor, and the monitor on the printing 
apparatus side is switched to the energy-saving mode. 
Processing waits until the transfer switch on the 

10 camera side is turned on at step S10, and when the 

transfer switch is turned on, image data in the camera 
is transferred to the printer at step Sll. 

Then, at step S12, an image to be printed is 
designated on the camera side, and thereafter 

15 processing waits until the print switch is pressed on 
the camera side. When the print switch on the camera 
side is turned on, an instruction for printing is sent 
to the printing apparatus in a command or file format, 
and the operation of printing the designated image is 

20 performed in the printing apparatus at step S13. 

Furthermore, when the print operation in step S13 is 
completed, processing returns to step S12. 

As described above, according to the embodiment, 
an external image processing apparatus such as the 

25 printing apparatus can be connected directly to an 
image storage apparatus such as the image sensing 
apparatus by wire or wireless means without the 
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involvement of a PC and controlled to easily perform 
processing such as the printing of sensed images (other 
processing includes image editing) , thus making it 
possible to achieve image processing environment of 
5 superior usability such as photographing, searching and 
printing . 

Also, even in the case where different types of 
image storage apparatus and external image processing 
apparatus are used in combination, control can 

10 automatically performed to carry out optimum processing. 
Thus, operational errors and the like can be prevented 
to improve operational characteristics significantly. 

Further, the object of the present invention can 
also be achieved by providing a storage medium storing 

15 program codes for performing the aforesaid processes to 
a computer system or apparatus (e.g., a personal 
computer) , reading the program codes, by a CPU or MPU 
of the computer system or apparatus, from the storage 
medium, then executing the program. 

20 In this case, the program codes read from the 

storage medium realize the functions according to the 
embodiment, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy disk, 

25 a hard disk, an optical disk, a magneto-optical disk, 
CD-ROM, CD-R, a magnetic tape, a non-volatile type 
memory card, and ROM, and computer network, such as LAN 
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(local area network) and WAN (wide area network) , can 
be used for providing the program codes. 

Furthermore, besides aforesaid functions according 
to the above embodiment are realized by executing the 
5 program codes which are read by a computer, the present 
invention includes a case where an OS (operating 
system) or the like working on the computer performs a 
part or entire processes in accordance with 
designations of the program codes and realizes 

10 functions according to the above embodiment . 

Furthermore, the present invention also includes a 
case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is inserted into the computer or in a memory 

15 provided in a function expansion unit which is 

connected to the computer, CPU or the like contained in 
the function expansion card or unit performs a part or 
entire process in accordance with designations of the 
program codes and realizes functions of the above 

20 embodiment. 

The present invention is not limited to the above 
embodiments and various changes and modifications can 
be made within the spirit and scope of the present 
invention. Therefore to apprise the public of the 

25 scope of the present invention, the following claims 
are made. 
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